-
Notifications
You must be signed in to change notification settings - Fork 313
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement defocus deblurring. #469
base: main
Are you sure you want to change the base?
Conversation
How to use this method? What is the command? |
Run |
I tried with multi GPU support, but it did not work:
It worked well with single GPU setup. I will share the result later. Its training now. |
Some of result is coming :) Top video = Gsplat MCMC with 500k splats & Data-Factor 4. defocuscupcake_comparison_29999.mp4defocusdaisy_comparison_29999.mp4defocusseal_comparison_29999.mp4It worked well with single GPU setup. Hopefully the multiGPU setup will be fixed. |
Gsplat MCMC with 500k splats & Data-Factor 4.
Gsplat MCMC with 500k splats & Data-Factor 4 with Defocusing.
Tested with : |
Thanks for running this. I can get slightly higher metrics with different hyperparameters but I haven't been able to beat the 23.61 avg reported in the original paper. Also, if anyone has an out of focus real world dataset, I'd be curious to see how this performs. |
How about using higher num of splats such as 1 million? |
I found 250k and 500k get similar metrics. The original paper uses ~300k so it would be good to keep things fair. |
BTW SSIM is the way higher than the original paper. (0.861 vs 0.7471) 👍 |
I looked into it briefly. The SSIM implementation is different so don't pay much attention to that. |
Somehow, it do not work good in Gsplat MCMC with 500k splats & Data-Factor 4
Gsplat MCMC with 500k splats & Data-Factor 4 with Defocusing.
How about other real world dataset? I tested a dataset called |
Seems an interesting update. Hopefully I can benchmark it with previous dataset again. |
Here is it my benchmark. Hopefully it will helpful for you @jefequien Gsplat MCMC with 500k splats & Data-Factor 4 with Defocusing commit 8f7e92c.
Gsplat MCMC with 500k splats & Data-Factor 4 with Defocusing commit d9db9e0
|
Loosely based on Deblurring 3D Gaussian Splatting, https://arxiv.org/pdf/2401.00834 and BAGS, https://arxiv.org/pdf/2403.04926.
Each step requires rendering both clear and blurry images so this method is >2x slower than normal 3DGS.
defocuscake_15k.mp4
Evaluation
Run
bash examples/benchmarks/mcmc_deblur.sh